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(54) Video image decoding method and apparatus 



(57) When stream video image signal are decoded 
simultaneously, and synchronised so as to be displayed 
on a screen, it prevents the disturbance of the displayed 
video image caused by changing the master. The DE- 
MUX 101 separates each channel video image signal 
and PCR from the multiplexed stream. The separated 
video image signal is stored in the input buffer memories 
107 through 101 . The master selector comprised of the 
PCR selector 120 and the STC selector 121 selects the 



master. The selected master STC, the comparator 1 23, 
the LPF 124 and the VC0125 comprise the PLL From 
the VOC 125 the system clock is regenerated, and the 
synchronising signal generator 126 generates the de- 
code starting signal and the display synchronising signal 
based on the system clock. From the STC counters 1 03 
through 106 the reference time information of each 
channel is obtained. The decoding controllers 111 
through 114 work over each decoder 115 through 118 
to start decoding based on the decode starting signal. 
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Description 

[0001] The present invention generally relates to a 
video image signal decoding method and apparatus for 
decoding a plurality of decoded video image signals si- 
multaneously. 

[0002] Conventionally, in the system for transmitting 
the moving picture or the audio such as the television 
broadcast, the television conference system or the tel- 
evision telephone, or the system for recording the mov- 
ing picture or the audio signal in the magnetic disc, the 
optical disc or the magnetic tape, and for reproducing 
the recorded signal, the high efficiency coding is per- 
formed then the transmission efficiency enhanced, in or- 
der to use the transmission channel or the recording me- 
dium effectively. 

[0003] Also in recent years, a digital satellite broad- 
cast via a broadcast satellite or communications satellite 
starts in order to solve the channel insufficiency of the 
analog ground wave television broadcasts or to develop 
new multi-channel services. Also, there are moves of 
digitizing the cable television (CATV) transmitted 
through a communication channel of coaxial cables or 
optical fiber cables or the ground wave broadcast. 
[0004] ' Since in the digital broadcast the digitized vid- 
eo image signal or audio signal are high efficiency com- 
pressed through the use of the compression technique 
such as the MPEG system or the AC-3 system it is pos- 
sible to secure channels by six to eight times larger than 
that in a conventional analog broadcast system in the 
same band width, so as to enhance a variety of services. 

[0005] There is an MPEG-2 (MPEG stands for Moving 
Picture Expert Group) as a typical high efficiency coding 
system. The MPEG-2 is a coding standard which has 
been fostered standardization as the ISO/IEC 13818 
which is the JTC (Joint Technical Committee) of the ISO 
(International Organization for Standardization) and the 
IEC (International Electro-Technical Commission). 
[0006] MPEG-2 defines not only the coding, but also 
the multiplexing of the video or the audio data streams 
in order to make use of data streams of encoded video 
and/or audio data for a wide range of applications. This 
standard is called the MPEG-2 standard, and there are 
two kinds according to the use of data stream, i.e., the 
transport stream (TS: Transport Stream) for the broad- 
cast and communicating, and the program stream (PS: 
Program Stream) for the storing and recording. 
[0007] The transport stream is considered to transmit 
a plurality of programs in one stream, which will be sup- 
plied to many broadcast or communicating in the future. 
[0008] On the other hand, it has been possible to de- 
code the MPEG compression video image signal in the 
DSP (Digital Signal Processor). Since the processing 
faculty of the hardware in the DSP or the IC motion 
speed are improved, it is also possible to decode a plu- 
rality of video image signals or audio signals contained 
in the MPEG streams. 



[0009] In the digital broadcast system, at the transmit- 
ter side, a plurality of MPEG-encoded video image data 
(TS packets) are multiplexed into one transport stream, 
and the transport stream and other transport streams 
5 generated in the similar manner are transmitted to the 
transponder such as the satellite by carrier waves with 
different frequencies, and in receivers a plurality of 
transport streams which are transmitted in conjunction 
with carrier waves with the different frequencies are de- 

10 coded in the decoder different for each frequency (con- 
taining the tuner), and from each decoded transport 
stream one selected video image data is MPEG-decod- 
ed, so that the decoded video image signals are dis- 
played on the multiple screen of the display device such 

15 as the cathode lay tube (CRT), or a MPEG-decoded vid- 
eo images are displayed on different display devices. 
[0010] When such a digital TV broadcast is received, 
in order to make it simple for viewer to select a desired 
channel, the video image signals in a plurality of chan- 
ge nels are decoded simultaneously, a TV screen is divided 
into a plurality of small screens, so as to provide the multi 
screen display function to display these decoded chan- 
nel video image signals on the respective small screens 
simultaneously. 

2S [0011] That is, it is assumed that the MPEG transport 
stream in which a plural channel of encoded TV signals 
are multiplexed is received, and each channels is simul- 
taneously decoded and the combined together so as to 
be displayed in multi-windows on a TV screen. In this 

30 case, as shown in FIGURE 1, the transport stream is 
demultiplexed into each TV channels in a demultiplexer 
(DEMUX) 1 01 , then each of the TV channels are stored 
in each of the input buffer memories 201 through 204. 
[0012] Here the circuit of FIGURE 1 represents a re- 

35 lated art imagined by Inventors for reference purposes 
to make the understanding of the present invention as 
described later easy, wherein a plurality of basic low cir- 
cuits each comprised of one conventional decoder are 
coupled in parallel. Then, these video image signal 

40 streams are decoded separately in the decoders 115 
through 118, and each of the decoded video image sig- 
nals is stored in each of the output buffer memories 205 
through 208. 

[0013] Then, as shown in FIGURE 2, the video image 
45 signal in each channel is decoded according to the de- 
code starting information contained in the video image 
signal stream in each channel. Further, in these video 
image signal streams to be decoded a video image sig- 
nal to be assigned to a master video image signal is se- 
so lected^ and the decoded video image signals stored in 
the output buffer memories 205 through 208 are read 
out by the use of a synchronizing signal reproduced from 
the data which are used when the video image signal 
assigned to the master video image signal is displayed, 
55 then these decoded video image signals are displayed 
on one screen after synchronized with each other in a 
synchronizer 119. 

[0014] However in the conventional apparatus men- 
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tioned above, in order to mach the Synchronization tor 
combining the decoded video image signals the output 
buffer memory for storing the decoded video image sig- 
nal is required. 

[0015] Further, through the use of that of the video im- 
age signal to be assigned to a master video image signal 
for the vertical synchronizing signal of the display, the 
synchronizing signal is changed every when the mater 
is changed, as shown in FIGURE 2, so that the phase 
of the vertical synchronizing signal is also changed si- 
multaneously. Accordingly there had been a problem 
that the displayed video image is disturbed at the master 
changing time. 

[0016] FIGURE 3 isa block diagram showing the con- 
ventional MPEG decoder for processing a plurality of 
video image data. Here, it will be explained that the two 
video image data selected from each two transport 
streams are supplied to each first and the second video 
decoders 10 and 20 as the two input streams. The two 
input streams are supplied to the input terminals 1 1 and 

21 of the first and the second video decoders, respec- 
tively. The video streams supplied to the input terminals 
11 and 21 are supplied to the MPEG decoders 12 and 

22 inside the first and the second video decoders so as 
to output the MPEG-decoded video image signals to the 
output terminals 13 and 23. 

[0017] To the MPEG decoders 12 and 22, the clock 
counting values from the STC counters 15 and 25 (STC 
stands for the System Time Clock meaning the refer- 
ence synchronizing signal), and the synchronizing sig- 
nals from the synchronizing signal generators 18 and 
28 based on the clock counting value are supplied. 
[0018] In the PCR detectors 14 and 24 the PCR (Pro- 
gram Clock Reference : the program time reference val- 
ue) which are the reference time information of the video 
image signals are extracted from each streams supplied 
to the input terminals 11 and 21. Each video decoders 
10 and 20 are provided with each separated generators 
17 and 27. Here, the PCR is contained in the input 
stream at a specific cycle (for instance, the cycle of 
100ms), which is used for setting or correcting the 
counts of the STC counters 15 and 25 to the desired 
counts intended at the MPEG encoder side by periodi- 
cally comparing and consulting with the PCR. 
[001 9] The clock generated in the clock generator 1 7 
inside the first video decoder 10 is counted in the STC 
counter 15. In the comparator 16, the PCR extracted 
from the first input stream in the PCR detector 14 and 
the count of the STC counter 15 are compared. Here, 
in the case that the difference between the values is rel- 
atively large the current PCR is loaded to the STC coun- 
ter 1 5. While in the case that the difference is relatively 
small the frequency offset of the clock is detected from 
the difference information and the frequency is correct- 
ed to the clock generator 17. 

[0020] The clock generated in the clock generator 27 
inside the second video decoder 20 is counted in the 
STC counter 25. In the comparator 26, the PCR extract- 



ed from the second input stream in the PCR detector 24 
and the count of the STC counter 25 are compared. 
Here, in the case that the difference between the counts 
is relatively large the PCR is loaded to the STC counter 
5 25, and the in the case that the difference is relatively 
small the frequency offset of the clock is detected from 
the difference information and the frequency is correct- 
ed to the clock generator 27. 

[0021 ] Accordingly, since the clock generators 1 7 and 
10 27 oscillate at the frequency depending on the two input 
video streams, the MPEG decoding systems are oper- 
ated by two clocks. 

[0022] By the way, in the MPEG decoder, in the case 
of performing the video image signal processing in the 

15 DSP, the two video image data are possible to be proc- 
essed in one DSP if it is a high speed type one, however, 
since one DSP is operated by one clock its processing 
is hard. Further, since the circuit systems operated by 
two clocks are not operated by the one clock it is hard 

20 to set up the controller, and since the distribution of the 
clock is fixed at the setup timing of each circuit the sys- 
tem with less flexibility. 

[0023] It is, therefore, the present invention has an ob- 
ject to remove the drawbacks in the conventional appa- 

2S ratus and provide a video image signal decoding meth- 
od and apparatus for preventing the disturbance of the 
displayed video image when a master video image is 
interchanged among a plurality of video images simul- 
taneously displayed on the screen. 

30 [0024] Further the present inventions has another ob- 
ject to provide a video image signal decoding method 
and apparatus for eliminating output buffer memories 
used for combining video image signals and for reducing 
the amount of hardware in the video image signal de- 

35 coder. 

[0025] So, the present invention provides a decoder 
for performing a plurality of decode processings by one 
clock, so as to make the system set up easy. 
[0026] In order to achieve the above object, a video 

40 image signal decoding method according to the first as- 
pect of the present invention includes the steps of a first 
step for separating at least one of streams of video im- 
age signal to be decoded from a multiplexed stream re- 
ceived therein, which contains a plurality of video image 
signals, a second step for selecting one stream includ- 
ing a video image signal to be assigned to a master vid- 
eo image signal, which will be assigned to a master 
stream from the multiplexed stream, a third step for re- 
generating a reference time and a system clock which 

50 are used in decoding of the video image signal to as- 
signed to the master video image signal, based on a ref- 
erence time information contained in the master stream, 
a fourth step for regenerating a reference time used for 
decoding the separated video image signal through the 

55 use of the reference time information contained in the 
separated stream of the video image signal to be de- 
coded and the regenerated system clock, a fifth step for 
generating a decode starting signal through the use of 
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the regenerated system clock, a si>cth step for storing 
the video image signal contained in the separated 
stream in an input buffer memory, in parallel with the 
processing of the steps 2 through 5, and a seventh step 
for starting a decoding of the video image signal stored s 
in the input buffer memory by the decode starting signal. 
[0027] A decoder according to the first aspect of the 
present invention includes a separator for separating at 
least one of streams of video image signal to be decod- 
ed from a multiplexed stream received therein, which 10 
contains a plurality of video image signal, a selector for 
selecting one stream including a video image signal to 
be assigned to a master video image signal, which will 
be assigned to a master stream from the multiplexed 
stream, at least one buffer memory for storing the video is 
image signal contained in each separated stream, a 
clock regenerator for regenerating a reference time and 
a system clock which are used in decoding of the video 
image signal to assigned to the master video image sig- 
nal, based on a reference time information contained in 20 
the master stream, a reference time regenerator for re- 
generating a reference time used for decoding the sep- 
arated video image signal through the use of the refer- 
ence time information contained in the stream of the vid- 
eo image signal to be decoded and the regenerated sys- 25 
tern clock, a decode starting signal generator for gener- 
ating a decode starting signal which is common to each 
of the separated stream through the use of the regen- 
erated system clock, and at least one decoder for start- 
ing a decoding of the video image signal stored in the 30 
input buffer memory by the decode starting signal. 
[0028] Further in the first aspect of the present inven- 
tion, the decode starting signal is a signal synchronized 
with a synchronizing signal in a display system which is 
not depend upon the decode starting time information 35 
contained in the video image signal to be assigned to a 
master video image signal. 

[0029] Furthermore in the first aspect of the present 
invention, the capacity secured as the input buffer mem- 
ory must be larger more than the maximum data amount 40 
supplied for one frame period of the video image signal 
assigned to the master video image than the data 
amount required for starting decoding based on the de- 
code starting time information contained in the data. 
[0030] According to the first aspect of the present in- 
vention, since at least one stream to be decoded sepa- 
rated from the multiplexed stream, that the streams con- 
taining the encoded video image signal are multiplexed, 
are stored in each of the input buffer memories, and the 
video image signal are decoded in each decoders which so 
correspond to the input buffer memories by the common 
decode starting signal of each streams, the timings of 
the video image signal output from each decoders are 
matched, and the video image signal is possible to be 
combined into one screen in the combiner directly with- ss 
out using of output buffer memories. 
[0031] Further, since the phase of the synchronizing 
signal is not disturbed even the stream of the video im- 
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age signal to be assigned to a master video image signal 
is interchanged it is possible to prevent the disturbance 
of the displayed video image at the master changing 
time. 

[0032] According to the second aspect of the present 
invention, a decode processor configured to decode a 
stream of MPEG-encoded video image data transmitted 
in conjunction with reference time information includes 
a reference time information detector for detecting the 
reference time information contained in the stream, a 
clock generator for generating a clock having a frequen- 
cy which is not locked to a clock in atransmitter for trans- 
mitting the stream, a counter for counting the clock from 
the clock generator, which count is amended by the di- 
rection from the reference time information detector, a 
synchronizing signal generator for generating a syn- 
chronizing signal based on the count of the counter, and 
a decoder for decoding the stream according to the 
count of the counter. 

[0033] According to the second aspect of the present 
invention, when two video image data having each ref- 
erence time information for instance are decoded in the 
first and the second video decoders the decode proces- 
sor according to the second aspect of the present inven- 
tion is used at least for the first video decoder, so that it 
is possible to decode one clock from the clock generator 
in the first and the second video decoders in common. 
This is, on one hand, the clock from the clock generator 
is used as that of the second decoder, on the other hand, 
when the clock from the clock generator is used by 
counted in the counter of the first video decoder the 
counting value is corrected by the detected value from 
the reference video information detector inside the first 
video decoder. That is, it is possible to provide the sys- 
tem capable of decoding the one clock non-synchro- 
nized with a plurality of video decoders. 
[0034] Additional objects and advantages of the 
present invention will be apparent to persons skilled in 
the art from a study of the following description and the 
accompanying drawings, which are hereby incorporat- 
ed in and constitute a part of this specification. 
[0035] For a better understandings of the' present in- 
vention and many of the attendant advantages thereof, 
reference will now be made by way of example to the 
accompanying drawings, wherein: 

FIGURE 1 is a block diagram showing the construc- 
tion of the conventional decoder; 
FIGURE 2 is a decoding timing chart explaining the 
conventional operation; 

FIGURE 3 is a block diagram showing a conven- 
tional decode processor; 

FIGURE 4 is a block diagram showing the construc- 
tion of the decoder in this embodiment according to 
the first aspect of the present invention; 
FIGURE 5 is a detail block diagram showing the 
construction of the decoder used in the embodi- 
ment; 
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FIGURE 6 is a decoding timing chart for explaining 

the operation of the embodiment; 

FIGURE 7 is a block diagram showing the decode 

processor of the first embodiment according to the 

second aspect of the present invention; 

FIGURE 8 is a block diagram showing the basic 

processing circuit used in FIGURE 7; 

FIGURE 9 is a diagram explaining the operation of 

FIGURE 2; 

FIGURE 10 is a block diagram showing the whole 
construction of the digital broadcast system accord- 
ing to the second aspect of the present invention; 
FIGURE 11 is a diagram showing the data construc- 
tion of the MPEG-2 transport packet; 
FIGURE 12 is a block diagram showing the decode 
processor of the second embodiment according to 
the second aspect of the present invention; 
FIGURE 13 is a block diagram showing the decode 
processor of the third embodiment according to the 
second aspecl of Ihe present invention; 
FIGURE 14 is a block diagram showing the con- 
struction for displaying the two video images on one 
screen by connecting to the output of the decode 
processor, as shown in FIGURES 7, 2 and 1 3; 
FIGURE 15 is a block diagram showing the decode 
processor of the fourth embodiment according to 
the second aspect of the present invention; 
FIGURE 16 is a diagram showing the operation of 
. FIGURE 15; 
FIGURE 17 is a block diagram showing the decode 
processor of the fifth embodiment according to the 
second aspect of the present invention; 
FIGURE 18 is a block diagram showing the decode 
processor of the sixth embodiment according to the 
second aspect of the present invention; and 
FIGURE 19 is a block diagram showing the con- 
struction for displaying the two video images on one 
screen by connecting to the output of the decode 
processor, as shown in FIGURES 15, 17 and 18. 

[0036] The present invention will be described in de- 
tail with reference to the FIGURES 4 through 1 9. 
[0037] Referring now to the attached drawings, an 
embodiment of the first aspect of the present invention 
will be explained in detail. 

[0038] In the embodiment, an example for decoding 
the transport stream wherein four MPEG -encoded mov- 
ing picture signals have been multiplexed (hereinafter 
referred to as ch1 through ch4) will be explained. 
[0039] FIGURE 4 is a block diagram showing the con- 
struction of the embodiment of the video image signal 
decoder according to the first aspect of the present in- 
vention. In FIGURE 4, the video image signal decoder 
is provided with a demultiplexer 101 (hereinafter re- 
ferred to as DEMUX) that is the separator for separating 
the encoded video image signal stream from the trans- 
port stream, a PCR extractor 102 for separating and ex- 
tracting the PCR that is the reference time information 
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of each channels, contained in the DEMUX 101, STC 
counters 103through 106 for regenerating the reference 
time of each channels through the use of each PCR, a 
PCR selector 120 and a STC selector 121 that are the 

s master selector for selecting the PCR and STC counters 
to be masters from the four channels PCR and STC 
counters, input buffer memories 107 through 110 for 
storing video image signal stream of each channels sep- 
arated from the DEMUX 101 , a comparator 123forcom- 

10 paring the counter values of the PCR and STC which 
are selected as the master, a low pass filter (LPF) 1 24, 
a voltage-controlled oscillator (VCO) 1 25 for generating 
the system clock, a synchronizing signal generator 126 
for generating the display synchronizing signal and the 

is decode starting signals which are common with each 
channels based on the system clock, decoding control- 
lers 111 through 114 for starting decoding the encoded 
video image signal stored in the input buffer memories 
107 through 110 according to the decode starting signal, 

20 decoders 115 through 118 for starling decoding the en- 
coded video image signal of each channels by control- 
ling in the decoding controllers 111 through 114. and a 
combiner 11 9 for combining four channels decoding re- 
sults. 

25 [0040] Here, the STC counter to be a master which is 
selected in the STC selector 121 , the comparator 123, 
the LPF 124, and the VCO 125 form a PLL (phase lock 
loop) which is system clock regenerator. From the se- 
lected STC counter the reference time used for decod- 

30 ing the video image signal to be a master is obtained, 
and from the VOC 125 the system clock used in com- 
mon with the each channels is obtained. 
[0041] Further, FIGURE 5 is a block diagram showing 
the internal arrangement of the decoder 115. Four de- 

35 coders 115 through 118, as shown in FIGURE 4, having 
configurations similar to each other are identical with the 
conventional MPEG decoder. Thus they are illustratively 
represented by the decoder 15. In FIGURE 5, the de- 
coder 115 is provided with a variable length decoder 

40 141 , an inverse quantizer 1 42, an inverse DCT (inverse 
Discrete Cosine Transform) unit 143, a motion compen- 
sator 144, a decoder memory 146, and an output filter 
1 45. The encoded video image signal stored in the input 
buffer memory 107, as shown in FIGURE 4, is supplied 

45 to the variable length encoder 141. And the decoding 
controller 111 controls the whole over the decoder 115. 
[0042] Now, the operation of the video image signal 
decoder, as shown in FIGURE 4, will be explained. The 
input transport stream is separated into four channel en- 

so coded video image signal streams based on the packet 
identifier (hereinafter, referred to PID) in the transport 
stream by the DEMUX 1 01 ,and these data streams are 
stored in the input buffer memories 1 07 through 1 1 0 de- 
fined on each channels, then they are decoded in the 

55 decoders 115 through 118 by each channels. 

[0043] Here, the video image signal of chl is decoded 
in the decoder 115 through the use of the STC counter 
103 as the reference time. In the similar manner, thevid- 
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eo image signal of ch2 is decoded in the decoder 116 
according to the reference time counted in the STC 
counter 104. The video image signal of ch3 is decoded 
in the decoder 117 according to the reference time 
counted in the STC counter 1 05. The video image signal $ 
of ch4 is decoded in the decoder 118 according to the 
reference time counted in the STC counter 106. 
[0044] Further, the PCRs of the respective channels 
are extracted from the input streams in the PCR extrac- 
tor 102, and then transmitted to the STC counters 103 to 
through 106, respectively. 

[0045] First, the operation for regenerating the system 
clock and reference time (STC) in the case that the mas- 
ter stream is chl will be explained. From the stream input 
totheDEMUX101 the PCR contained in the chl stream is 
is extracted through the use of the PCR extractor 102, 
then the PCR is transmitted to the STC counter 1 03. The 
STC counter 103 receives the chl stream. When receiv- 
ing the first PCR, the STC counter 1 03 captures the PCR 
and then activates the STC counters 103 through 104 20 
according to the system clock output from the VCO 1 25. 
[0046] When a next PCR in chl is extracted in the 
PCR extractor 1 02 the next order PCR in the chl and the 
STC count of the chlcounted in the counter 103 are sup- 
plied to the PLL which is comprised of the comparator 2S 
1 23, the LPF 1 24 and the VCO 1 25 via the PCR selector 
1 20 that is the master stream selector and the STC se- 
lector 121, then the system clock locked to the chl 
stream is regenerated. In the similar manner, according 
to that the difference is reflected to the PLL the stable 30 
system clock is kept regenerating. 
[0047] Here, when the master stream is interchanged 
with that in other channel, an abrupt change of the fre- 
quency of the system clock will be avoided by loading 
the PCR detected just after changing the master stream 35 
to the STC counter and making the difference just after 
changing is zero. 

[0048] On the other hand, about the streams of ch2, 
ch3, and ch4 that are the slavestreams but the master 
stream, the PCR contained in each slavestreams is ex- 40 
tracted in the PCR extracter 102, then the PCRs are 
transmitted to the STC counters 104, 105 and 106 which 
are corresponding to each ch2 3 ch3, and ch4. These 
STC counters 104 through 106 downloads these trans- 
mitted PCR to each counters, and operates the counters 
according to the system clock locked to trie master 
stream output from the VCO 1 25. that is, the STC coun- 
ter allotted to the slave streams performs the counting 
operation as rewriting the count of the STC counter into 
the PCR every when the PCR is extracted. so 
[0049] Now, the operation for generating the decode 
starting signal from the system clock which is synchro- 
nizing to the master stream will be explained. The de- 
code starting signal and the vertical and horizontal dis- 
play synchronizing signal are generated by transmitting ss 
the system clock output from the VOC 125 to the syn- 
chronizing signal generator 126 and dividing the trans- 
mitted system clock in the counter or the divider. 
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[0050] Originally, the decode starting signal should be 
controlled to coincide with the decoding start time (here- 
inafter, referred to DTS) information contained in the 
master stream. However, in the first aspect of the 
present invention, the decode starting signal is gener- 
ated in the system clock without the use of the DTS. 
[0051] Accordingly, even in the case that a master 
stream is interchanged from one in chl to another in 
ch2, as shown in FIGURE 6, the decode starting signal 
is generated at the fixed phase regardless of the phase 
of the decode starting information contained in each ch. 
Further, the frequency of the decode starting signal is 
coincided with the flame rate of the master stream. That 
is, it is needless to say that the frequency of the decode 
starting signal is changed to the flame rate of the 
changed master stream if the master stream has been 
interchanged. 

[0052] Now, the decode starting operation in each de- 
coder will be explained. 

[0053] When the decode starting signal which is com- 
mon to each channels generated in the way mentioned 
above is supplied to the decoding controller 111 through 
114, the values of each STC counters 103 through 106 
is compared to the DTs contained in the streams at that 
timing. 

[0054] According to this comparison, when the value 
of the DTS is smaller than the STC counter value, the 
decoding of the present flame starts in the correspond- 
ing decoder at the timing of the decode starting signal. 
Here, it is needless to say that when the DTS is smaller 
than the STC counter value by at least one flame, the 
decoding is skipped up to the flame that the DTS is larg- 
er than the count of the STC counter. 
[0055] If the DTS is larger than the count of the STC 
counter the decoding operation is deactivated until the 
next decode starting signal is supplied. Further, rf the 
data are that of the flame which does not contain the 
DTS the flame is decoded at the timing of the input de- 
code starting signal, a's well as the DTS is determined 
to be smaller than the STC counter. 
[0056] Here, since the each ch data start at the de- 
code starting time different from the original decode 
starting time information (DTS) (see FIGURE 6), the de- 
code starting time in the decoders 115 through 118 of 
each channels is delayed for one flame time of the video 
image signal to be assigned to a master video image 
signal in maximum compared with the original DTS time. 
Accordingly, the input buffer memories 107 through 110 
are required to have buffer capacities larger than the in- 
put buffer capacities required to initiating the decoding 
at the essential DTS, by more than the maximum data 
amount supplied for one frame period of the video image 
signal to be assigned to the master picture. 
[0057] Accordingly, a plurality of channel video image 
signals decoded simultaneously are possible to be out- 
put by synchronizing into one screen via the synchro- 
nizer 1 1 9 for instance, without having the output buffer 
memory for matching synchronization in the decoders 
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115 through 118. 

[0058] Furthermore, since the display vertical and 
horizontal synchronizing signal is generated in the syn- 
chronizing signal generator based on the system clock 
regardless of the decode starting time information con- $ 
tained in the encoded video image signal stream to be 
assigned to a master stream, the phase of the synchro- 
nizing signal is not affected by the interchange of the 
master, so that there is no disturbance on the screen at 
the master changing time. 10 
[0059] Referring not to FIURES 7 through 10, an em- 
bodiment of the second aspect of the present invention 
will be explained hereinafter. FIGURE 7 is a block dia- 
gram showing the decode processor of the first embod- 
iment of the second aspect of the present invention. 15 
FIGURE 8 is a block diagram showing the basic 
processing in the decoder, as shown in FIGURE 7. Ac- 
cordingly, FIGURE 7 shows the embodiment for decod- 
ing a plurality of input video image data through the use 
of the circuit of the FIGURE 8 as its basic configuration. 20 
FIGURE 9 is a diagram for explaining the operation of 
FIGURE 8. FIGURE 10 is a block diagram showing the 
general construction of the digital broadcast system ac- 
cording to the second aspect of the present invention. 
[0060] For a start, the general construction of the dig- 25 
ital broadcast system will be explained in reference to 
FIGURE 1 0. In the digital broadcast system, at the trans- 
mitter side, a plurality of video image signals captured 
by imaging devices 51 through 57 are supplied to the 
MPEG encoders 61 through 67, and then MPEG-encod- 30 
ed by the MPEG encoders 61 through 67 so as to gen- 
erate the transport packet. In FIGURE 10, the MPEG 
encoders 61 through 67 are divided into three transport 
groups, and a-plurality of MPEG encoders 61 through 
63 (in FIGURE 10, three MPEG encoders are provided) 35 
are operated by the clock generated from a clock gen- 
erator 71. A plurality of MPEG encoders 64 and 65 (in 
FIGURE 10, two MPEG encoders are provided) are op- 
erated by a clock generator 72. In the similar manner, a 
plurality of MPEG encoders 66 and 67 (in FIGURE 10, 40 
two MPEG encoders are provided) are operated by the 
clock from a clock generator 73. Then, a plurality of TS 
packets output from the MPEG encoders 61 through 63 
are multiplexed in the multiplexer 81 into one transport 
stream, and the carrier wave is modulated in the mod- 45 
ulator 91 so as to be transmitted to the satellite 1 00 from 
the antenna, in the similar manner, a plurality of TS 
packets output from the MPEG encoders 64 and 65 are 
multiplexed in the multiplexer 82 into one transport 
stream, and the carrier wave is modulated in the mod- so 
ulator 92 so as to be transmitted to the satellite 100 
through an antenna, in the similar manner also, the TS 
packets output from MPEG encoders 66 and 67 are mul- 
tiplexed into one transport stream in the multiplexer 83, 
and the carrier wave is modulated in the modulator 93 55 
so as to be transmitted to the satellite 100 through the 
antenna. In the satellite 100 : three transport streams 
transmitted from the three transport groups are ampti- 
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fied in each different transponders 101 through 103 so 
as to be retransmitted. In the receiver these carrier 
waves by these transport streams are supplied to the 
digital broadcast receiver 200 through the antenna. The 
digital broadcast receiver 200 here has a construction 
capable of receiving the two transport streams at the 
similar manner. 

[0061] In the digital broadcast receiver 200, a plurality 
of transport streams transmitted by the carrier wave 
having the different frequency are demodulated in the 
different demodulators (containing the tuner) 211 and 
212 according to the frequency, and these decoded 
transport streams are supplied to the two demultiplexers 
221 and 222, where each one video image data is se- 
lected (or separated) from each transport stream, then 
these video image signal are MPEG-decoded in the first 
and the second video decoders 231 and 232 (each con- 
taining the MPEG decoder), so that it is possible to dis- 
play these two MPEG-decoded video image signals on 
the double-window screen of the display device 241 
such as the cathode-ray tube (CRT) as the main and 
sub signals, or display these MPEG-decoded two video 
image signals on individual display screens of the dis- 
play devices 241 and 242. 

[0062] FIGURE 11 shows the data construction of the 
MPEG-2 transport packet. The MPEG-2 System Layer 
defines that a plurality of video streams are packetized 
and multiplexed to one transport stream. Here, the pack- 
et of the each video streams multiplexed to one trans- 
port stream is called the transport packet (TS packet). 
In the TS packet there is a four-byte header having a 

■ PI D for identifying the packet. In the decoding of the sys- 
tem layer of the multiplexers 221 and 222, the PID is 

. extracted for identifying the packet. In the case that it is 
a packet of video image data to be decoded, the packet 
is extracted and transferred to the video decoders 231 
and 232. The PCR is defined on the optional field inside 
the adaptation field of the transport packet which is a 
video stream. The number of the video streams which 
are possible to be multiplexed into one transport stream 
will be six if the bit rate of the transport stream is 40 Mb/ 
s and the bit rate of the video stream is 6 Mb/s. If it is 
desired to transmit more further video image streams, 
a plurality of transport streams are used. To decode a 
plurality of video streams in the different transport 
streams, the digital broadcast receiver is needed to re- 
ceive a plurality of transport streams. 
[0063] FIGURE 7 shows a decode processor which 
corresponds to the first and the second video decoders 
231 and 232, as shown in FIGURE 10. In FIGURE 7, 
through the use of the basic circuit, as shown in FIGURE 
8 (which will be shown later) it is possible to decode the 
first and second video decoders non-synchronous in 
one clock generator. 

[0064] The decoder 1 , as shown in FIGURE 7, is com- 
prised of the first and the second video decoders decod- 
ing two of the video streams obtained by separating from 
each of the two transport streams. In FIGURE 7, the 
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same components as those, as shown in FIGURE 3 are 
assigned with the same marks. In this embodiment, the 
clock generator 17, as shown in FIGURE 3 is eliminated, 
and defined only one clock generator 27. 
[0065] The first video decoder is comprised of an input s 
terminal 11 of the video stream, an MPEG decoder 12 
which is the decoder, an output terminal 1 3 of the video 
image signal, a PCR detector 1 4A wh ich is the reference 
time information detector, a STC counter 1 5 which is the 
counter, a synchronizing signal generator 18 which is to 
the synchronizing signal generator, and an output ter- 
minal 1 9 of the synchronizing signal. The second video 
decoder 22 is comprised of an input terminal 21 o1 the 
video image signal, an MPEG decoder 22 which is the 
decoder, an output terminal 23 of the video image signal, is 
a PCR detector 24 which is the reference time informa- 
tion detector, a STC counter 25 which is the counter, a 
comparator 26, a clock generator 27 which is the clock 
generator, a synchronizing signal generator 28 which is 
Ihe synchronizing signal generalor, and an outpul ter- 26 
minal 29 of the synchronizing signal 29. 
[0066] The two video streams are supplied to the ter- 
minals 11 and 21 . The PCR which is the reference time 
information contained in the video stream, which is sup- 
plied to the terminal 1 1 is detected in the PCR detector 25 
14A. Further, the PCR which is the reference time infor- 
mation contained in the video stream, which is supplied 
through the terminal 21 is detected in the PCR detector 
24. The count of the STC counter 25 is compared with 
the PCR in the comparator 26, and the oscillating fre- 30 
quency of the clock generator 27 is controlled to make 
the difference smaller. The clock generated in the clock 
generator 27 have its frequency which matches to that 
of the clock at the transmitter side of the video stream 
which is supplied to the terminal 21 , however, generally 35 
it does not match to that of the clock at the transmitter 
side of the video stream which is supplied supplied 
through terminal 1 1 . The input terminal 1 1 , the PCR de- 
tector 14, the STC counter 15, the MPEG decoder 12, 
the synchronizing signal generator 18, the output termi- 40 
nal 13 and the synchronizing signal output terminal 19 
are constructing the basic circuit, as shown in FIGURE 
8. The MPEG decoder 12 decodes the data based on 
the count of the STC counter 1 5 (the value showing the 
reference time of the video stream supplied through ter- 45 
minal 1 1 ). Accordingly, two video image signals are out- 
put through terminals 1 3 and 23, while the synchronizing 
signals synchronized lo the video image signals outpul 
through the terminals 1 3 and 23 are output through the 
terminals 19 and 29. so 
[0067] FIGURE 8 is a block diagram for the basic op- 
eration in the decode processor, as shown in FIGURE 

7, while FIGURE 9 is a diagram for explaining the oper- 
ation of the decode processor. 

[0068] The basic configuration, as shown in FIGURE 55 

8, is comprised of a first video decoder comprised of el- 
ements 1 1 , 1 2, 1 3, 1 4A, 1 5, 1 8, 1 9, as shown in FIG URE 
7 and the clock generator 27 of the second video de- 
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coder. 

[0069] In FIGURE 8, the PCR is for transmit the value 
that the 27 MHz transmitter side clock is counted in the 
transmitter side counter at the specific cycle (since, for 
example the PCR is supplied in the cycle of 100 ms, 
assuming the one vertical period being 1 6.7 ms it is sup- 
plied in about every 6 vertical periods). It is provided with 
the 27 MHz clock generator 27 in the receiver, and it 
generates the 27 MHz clock in referring to the incoming 
PCR. The STC counter 1 5 counts the 27MHz clock out- 
put which is output from the clock generator 27. When 
the PCR is supplied in conjunction with the video stream 
through the terminal 11, the PCR detector 14A com- 
pares with the count of the STC counter 15 and stores 
the difference. Then, PCR detector 14A adds (or sub- 
tract) the difference and the output from the STC counter 
15 at the timing of generating the vertical synchronizing 
signal Vtrom the synchronizing signal generator 18, and 
calculates the vafue (hereinafter, referred to as the cor- 
rected value) that the STC counter 15 has to take, so 
that it loads the corrected value to the STC counter 15. 
The signal line which returns to the PCR detector 14A 
from the synchronizing signal generator 18, as shown 
in FIGURE 8 is for applying the vertical synchronizing 
signal VD from the synchronizing signal generator 1 8 to 
the PCR detector 14A. After the timing of the vertical 
synchronizing signal V is supplied, the PCR detector 
14A loads the corrected value based on the difference 
which is calculated when the PCR is arrived to the STC 
counter 1 5. Accordingly, after the loading to the correct- 
ed value to the STC counter 15 the arriving PCR and 
the count of the STC counter are always matched if the 
frequency of the clock generated in the clock generator 
27 matches perfectly to the frequency of the transmitter 
side clock. However in actual, since they are not always 
matched there will be the difference between the value 
of the next arriving PCR and the count of the STC coun- 
ter 15. 

[0070] FIG URE 9 shows the temporal progress of the 
STC counter 1 5, wherein the horizontal axis represents 
the time t and the vertical axis represents the count of 
the STC counter 1 5. It is assumed that the count of the 
STC counter 1 5 is 0 at the time 0. The count of the STC. 
counter 1 5 goes up as time goes. The synchronizing sig- 
nal generator 1 8 generates the horizontal synchronizing 
signal H and the vertical synchronizing signal V accord- 
ing to the count of the STC counter 1 5 and outputs them 
supplied through terminal 19. in FIGURE 9, the timings 
of outputting the horizontal synchronizing signal H and 
of generating the vertical synchronizing signal V are 
shown as H and V conceptually. Actually, the synchro- 
nizing signal generator 18 generates the vertical syn- 
chronizing signal V at the 525 H (about 1 6.7 ms) in case 
of the NTSC system, however, it is shown in FIGURE 9 
for simplifying that the vertical synchronizing signal v is 
generated at 4H. In actual, every time the count of the 
STC counter 15 for counting 27 MHz goes up 858 X 2 
= 1716, it makes the horizontal synchronizing signal H 
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of 15,734 KHz. Further, every time the value goes up 
858 x 525 = 450450 : it makes the vertical synchronizing 
signal H of 59.94KHz. In FIGURE 9, there is a disconti- 
nuity in the increase of the count of the STC counter 1 5 
just after the second occurrence of the time V by the 
synchronizing signal generator 1 8. This is where that the 
difference which is calculated based on the PCR is 
stored then the PCR detector 14A loads the corrected 
Vrtiuc b by ridded the count of the STC counter 1 5 at the 
time Vp HlteUhc time V to the STC counter 15. In this 
case the count of the STC is higher than the value of 
the Hf itvmq PCR This means that the clock frequency 
of the svnd'wom/ ng signal generator 27 of the receiver 
is 'd lutci h ghof thnn the transmitter side clock. Since 
the fond timing Vo of the corrected value b to the STC 
counici 1 5 becomes the time after the timing of the ver- 
tical synchtom/tnq signal V from the synchronizing sig- 
nal genciniot lr the timing of generating the next hor- 
izontal synchioni/mg signal H will be later. That is, the 
lime inteivril of it e timing of Ihe vertical synchronizing 
signal V nt-d rie iimniq of the next horizontal synchro- 
nizing signnl I which put ihe timing Vp to be loaded be- 
tween will be ionqer thrin the normal horizontal period 
(1H). However the following horizontal synchronizing 
signals H arc output in ;j fixed period (1 horizontal peri- 
od; 1H) Accordingly though the clock signal frequency 
of the clock generator 27 does not lock to the transmitter 
side stream to be supplied through terminal 11 , the av- 
erage frequency of the horizontal synchronizing signal 
H to be reproduced in the receiver and the vertical syn- 
chronizing signal V match perfectly to the horizontal and 
the vertical average frequency at the transmitter side. 
As the result, the moving picture is possible to be repro- 
duced without locking of the flames. Here, since the pe- 
riod between the liming of the vertical synchronizing sig- 
nal V and the timing of the next horizontal synchronizing 
signal H before and after the load timing Vp corresponds 
to the period of the top or the bottom of the screen, even 
if the horizontal trace interval is longer to a degree it 
does not affect the actual video image displayed for us- 
ers. 

[0071] FIGURE 12 is a block diagram showing the de- 
code processor of the second embodiment according to 
the second aspect of the present invention. Though in 
the embodiment of FIGURE 7 the STC counters are de- 
fined on each first and the second video decoders cor- 
responding to the input two video streams, in this sec- 
ond embodiment it is constructed lo have one STC 
counter. 

[0072] In FIGURE 1 2, the first video decoder is com- 
prised of the input terminal 11 of the video stream, the 
MPEG decoder 12 which is the decoder, the output ter- 
minal 1 3 of the video image signal, the PCR detector 1 4 
which is the reference time information detector, the 
synchronizing signal generator 18 which is the synchro- 
nizing signal generator, the output terminal 19 of the 
synchronizing signal, the comparator 31, the STC dif- 
ference register 32, and the adder 33. The second video 



decoder is comprised of the input terminal 21 of the vid- 
eo stream, the MPEG decoder 22 which is the decoder, 
the output terminal 23 of the video image signal, the 
PCR detector 24 which is the reference time information 
5 detector, the STC counter 25 which is the counter, the 
comparator 26, the clock generator 27 which is the clock 
generator, the synchronizing signal generator 28 which 
is the synchronizing signal generator, and the output ter- 
minal 29 of the synchronizing signal. Here, the compa- 
re rator 31 , the STC difference register, and the adder 33 
in the first video decoder is constructing the reference 
time generator for supplying the reference time to the 
MPEG decoder 12. 

[0073] The PCR detector 24 extracts the PCR which 

is is the reference time information from the video stream 
supplied through the terminal 21. The STC counter 25 
counts the clock generated in the clock generator 27. 
The output of the STC counter is compared -with the 
PCR supplied through the terminal 21 (the value detect- 

20 ed in the PCR detector 24) in the comparator (differen- 
tiator) 26, then the frequency of the clock generated in 
the clock generator 27 is controlled based on the conv- 
parison result. The frequency of the clock generated in 
the clock generator 27 matches to the clock frequency 

25 at the transmitter side of the video stream supplied 
through the terminal 21 . The PCR is extracted from the 
video stream supplied through the terminal 11 in the 
PCR detector 1 4, and the difference of the PCR and the 
count of the STC counter 25 is counted in the compara- 

30 tor 31 and stored in the STC difference register 32. The 
count of the STC counter 25 and the content of the STC 
difference register 32 are added in the adder 33, so as 
to get the value (count) showing the reference time of 
the video stream which is supplied through terminal 11 . 

35 Based on this value, the MPEG decoder 12 decodes, 
and the synchronizing signal generator 18 generates 
the synchronizing signal which is synchronized to the 
video image signal output through the terminal 1 3. 
[0074] In FIGURE 12,the STC counter 25 outputs the 

40 value (counting value) showing the reference time of the 
video stream which is supplied through terminal 21. 
Then, the reference time which is necessary for the de- 
coding of the terminal 11 is obtained by adding the con- 
tent of the STC difference register 32 to the count of the 

45 STC counter 25. However, if the reference time informa- 
tion (PCR) of the video stream which is supplied to the 
terminal 21 varies the count of the STC counter 25 also 
varies, so that the sum of Ihe count of the STC counter 
25 and the content of the STC difference register 32 rep- 

50 resents the reference time necessary for decoding the 
video stream supplied to the terminal 11. However the 
sum will change in the instance thatthe count of the STC 
counter 25 has changed. That is, when the count of the 
STC counter 25 changes, the reference time supplied 

55 to the MPEG decoder 12 is also changed. Accordingly, 
the comparator 31 requires the processing to shift the 
output content of the STC difference register 32 for the 
changed count of the STC counter 25 which is generat- 
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ed according to the change of the PCR of the terminal 
21. FIGURE 13 shows the embodiment that the count 
of the STC counter 25 does not effected by the change 
of the PCR of the terminal 21 . 

[0075] FIGURE 1 3 is a block diagram showing the de- s 
code processor of the third embodiment according to the 
second aspect of the present invention. 
[0076] In FIGURE 1 3, the first video decoder is com- 
prised of the input terminal 11 of the video stream, the 
MPEG decoder which is the decoder, the output terminal to 
1 3 of the video image signal, the PCR detector 1 4 which 
is the reference time information detector, the synchro- 
nizing signal generator 18 which is the synchronizing 
signal generator, the output terminal 1 9 of the synchro- 
nizing signal, the comparator 31 , the STC difference ?s 
register 32, and the adder 33. The second video decod- 
er is comprised of the input terminal 21 of the video 
stream the MPEG decoder 22 which is the decoder, the 
output terminal 23 of the video image signal, the PCR 
detector 24 which is the reference time information de- 20 
tector, the STC counter 25 which is the counter, the com- 
parator 26, the clock generator 27 which is the clock 
generator, the synchronizing signal generator 28 which 
is the synchronizing signal generator, the output termi- 
nal 29 of the synchronizing signal, the comparator 41, 2s 
the STC difference register 42, and the adder 43. The 
comparator 31, the STC difference register 32, and the 
adder 33 in the first video decoder is constructing the 
first reference 4ime generator. The comparator 31 , the 
STC difference register 42, and the adder 43 in the first 30 
video decoder is constructing the second reference time 
generator. 

[0077] In this construction the STC counter is also on- 
ly one. The PCR is extracted from the video stream add- 
ed to the terminal 21 in the PCR detector 24. The STC 35 
counter 25 counts the clock generated in the clock gen- 
erator 27. The count of the STC counter 25 and the PCR 
on the terminal 21 , i.e., the detection result of the PCR 
detector 24 are compared in the comparator 41 , and the 
difference is stored in the STC difference register 42. 40 
The video stream of the terminal 21 is decoded by sup- 
plying the value that the content of the STC difference 
register 42 is added to the count of the STC counter 25 
in the adder 43 to the KPEC decoder 22 as the reference 
time. The output of the adder 43 and the PCR from the 45 
PCR detector 24 are compared in the comparator 26. 
Based on this comparison result the oscillating frequen- 
cy of the clock generator 27 is controlled. Accordingly, 
the oscillation frequency of the clock generator 27 is 
synchronized to the transmitter side clock of the video so 
stream which is supplied to the terminal 21 . Here, since 
the PCR detected in the PCR detector 24 does not load- 
ed to the STC counter 25, the count of the STC counter 
25 is hard to be effected by the PCR change of the ter- 
minal 21. 55 
[0078] The PCR detector 14 extracts the PCR from 
the video stream which is added to the terminal 11 . The 
STC counter 25 counts the clock generated in the clock 
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generator 27. The count of the STC counter 25 and the 
PCR arrived to the terminal 31 are compared in the com- 
parator 31, and the difference is stored in the STC dif- 
ference register 32. The video stream of the terminal 11 
is decoded by supplying the value that the content of the 
STC difference register 32 is added to the count of the 
STC counter 25 in the adder 33 to the MPEC decoder 

12 as the reference time. 

[0079] Here, if it is desired that the oscillation frequen- 
cy of the clock generator 27 is synchronized to the clock 
on the terminal 21 which is supplied from the transmitter 
of the video image signal streara the oscillation frequen- 
cy of the clock generator 27 may be controlled based 
on the comparison result of the output value from the 
adder 33 and the PCR from the PCR detector 1 4 in the 
comparator 26. 

[0080] The STC counter 25 in the embodiment of FIG- 
URE 13 does not changed suddenly by the PCR con- 
tained in the input video stream. Accordingly, even if the 
video streams supplied to the terminal 11 and 21 are 
changed, they do not interfere each other. 
[0081] FIGURE 14 shows the construction of display- 
ing two video image signal on one screen by connecting 
to the output of the decode processor, as shown in em- 
bodiment of FIGURE 7, FIGURE 12 and FIGURE 13. 
To the terminal 11 and 21 the video streams are sup- 
plied. The video image signal output from the terminal 

13 is written in the memory 131 in the write controller 
135, according to the synchronizing signal supplied to 
the terminal 19. The synchronizing signal output from 
the terminal 29 is generally non-synchronized to the 
synchronizing signal output from the terminal 19. The 
video image signals read out from the memory 131 by 
the read controller 1 32 according to the synchronizing 
signal supplied through the terminal 29 are synchro- 
nized to the video image data supplied through the ter- 
minal 23. In this case, it is possible to enlarge or reduce 
the size of images by controlling the read-address. The 
video image data read out from the memory 131 are 
supplied to the combiner 1 33, where they are combined 
with the video image signal supplied through the termi- 
nal 23, and the combined video image signal is output 
through the terminal 134. This signal is supplied to the 
display device (not shown, but corresponding to the 
code 241 in FIGURE 10) to be displayed. 

[0082] FIGURE 15 is a block diagram showing the de- 
code processor of the fourth embodiment according to 
the second aspect of the present invention. In this em- 
bodiment, the synchronized signal generated in one 
synchronizing signal generator 28 is used in the MPEG 
decoders 1 2 and 22 withoutthe use of the synchronizing 
signal generator 18, as shown in FIGURE 7. 
[0083] In FIGURE 15, the first video decoder is com- 
prised of the input terminal 11 of the video stream, the 
MPEG decoder 12 which is the decoder, the output ter- 
minal 13 of the video image signal, the PCR detector 
14A which is the reference time information detector, 
and the STC counter 15 which is the counter. The sec- 
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ond video decoder is comprised of the input terminal 21 
of the video stream, the MPEG decoder 22 which is the 
decoder, the output terminal 23 of the video image sig- 
nal, the PCR detector 24 which is the reference time in- 
formation detector, the STC counter 25 which is the 
counter, the comparator 26, the clock generator 27 
which is the clock generator, the synchronizing signal 
generator 28 which is the synchronizing signal genera- 
tor, and the output terminal 29 of the synchronizing sig- 
nal. 

[0084] The horizontal synchronizing signal H and the 
vertical synchronizing signal V supplied from the syn- 
chronizing signal generator 28 are generally non syn- 
chronized to the transmitter side synchronizing signal of 
the video stream supplied from the terminal 11 . Accord- 
ingly, the synchronizing signal of the synchronizing sig- 
nal generator 28 will be non synchronized with each vid- 
eo flames contained in the video streams supplied to the 
terminal 11. 

[0085] FIGURE 16 is an operation explaining diagram 
in case that the video flame from the terminal 11 is de- 
coded non synchronized with the synchronizing signal 
of the synchronizing signal generator 28. FIGURE 16a 
represents the video flame contained in the video 
stream which is supplied to the terminal 11 . The arrow 
indicates the decoding state based on the count of the 
STC counter 1 5 of each video flames, and the tip of the 
arrow indicates the completion of decoding of the video 
flame. FIGURE 16b represents the timing of the vertical 
synchronizing signal supplied to the MPEG decoders 1 2 
and 22 from the synchronizing signal generator 28. FIG- 
URE 16c shows the video flame to be displayed. The 
input video flame and decoded to the MPEG decoder 
12 at the timing of the code 71 completes the decoding 
till the timing of the code 72, then it outputs the signals 
to the output terminal 1 3 at the timing of the vertical syn- 
chronizing signal of code 73 so as to start the display 
operation. 

[0086] Since the video flame of the terminal 11 is not 
synchronized with the synchronizing signal of the syn- 
chronizing signal generator 28, there will be the interval 
that the vertical synchronizing signal is not exist be- 
tween the video flame arrived till the timing of code 74 
and the video fiame arrived till the timing of the code 76. 
The video flame which is arrived till the timing of the code 
74 and decoded is not displayed since there is no ver- 
tical synchronizing signal for giving the display timing, 
and decodes the video flame arrived next till the timing 
of the code 76, then it is displayed at the timing of the 
vertical synchronizing signal arrived next. Accordingly, 
when the frequency of the vertical synchronizing signal 
used for the display is lower than the frequency of the 
video flame of the video stream the synchronization is 
possible to be taken by locking the transmitted video 
flame. On the other hand, when the frequency is higher, 
the synchronization is possible to be taken by displaying 
the same video flame repeatedly for several times. 
[0087] FIGURE 17 shows the decode processor of 



OCID: <EP 0924935A2_I_> 




924 935 A2 20 

the fifth embodiment according to the second aspect of 
the present invention. In FIGURE 17, the first video de- 
coder is comprised of the input terminal 11 of the video 
stream, the MPEG decoder 12 which is the decoder, the 

5 output terminal 1 3 of the video image signal, the PCR 
detector 14 which is the reference time information de- 
tector, the comparator 31, the STC difference register 
32, and the adder 33. The second video decoder is com- 
prised of the input terminal 21 of the video stream, the 

io ' MPEG decoder 22 which is the decoder, the output ter- 
minal of the video image signal, the PCR detector 24 of 
the reference time information detector, the STC coun- 
ter 25 which is the counter, the comparator 26, the clock 
generator 27 which is the clock generator, and the out- 

15 put terminal 29 of the synchronizing signal. The compa- 
rator 31, the STC difference register 32, and the adder 
33 in the first video decoder construct the reference time 
generator. 

[0088] In the embodiment of FIGURE 17, it defined 

20 only one STC counter 25 by replacing the two STC 
counters 15 and 25, as shown in FIGURE 15 with the 
comparator 31 , the STC difference register 32, and the 
adder 33 in a similar manner, as shown in FIGURE 12. 
[0089] FIGURE 1 8 is a block diagram showing the de- 

25 code processor of sixth embodiment according to the 
second aspect of the present invention. In FIGURE 18, 
the first video decoder is comprised of the input terminal 
11 of the video stream : the MPEG decoder 12, the out- 
put terminal 13 of the video image signal, the PCR de- 

30 tector 14, the comparator 31 , the STC difference regis- 
ter 32, and the adder 33. The second video decoder is 
comprised of the input terminal 21 of the video stream, 
the MPEG decoder 22, the output terminal 23 of the vid- 
eo image signal, the PCR detector 24, the STC counter 

35 25, the comparator 26, the clock generator 27, the syn- 
chronizing signal generator 28, the output terminal 29 
of the synchronizing signal, the comparator 41 , the STC 
difference register 42, and the adder 43. 
[0090] The embodiment of FIGURE 18 shows the 

40 construction for solving the problem of count change 
from the STC counter 25 based on the PCR in the em- 
bodiment of FIGURE 17 in the case of taking one STC 
counter. In this construction the drawback of the circuit 
of FIGURE 17 is solved in the similar manner taken in 

45 the construction of FIGURE 1 3 for solving the drawback 
that the count of the STC counter 25 changes in con- 
junction with the change of the PCR. That is, since the 
PCR delected in the PCR detector 24 does not loaded 
on the STC counter 25, the count of the STC counter 25 

50 is hard to be effected by the PCR change of the video 
stream which is supplied through terminal 21. 
[0091] FIGURE 19 shows the construction for display- 
ing two video image on one screen by connecting to the 
outputs of the decode processors, as shown in FIG- 

55 URES 15, 17 and 18. Tow video streams are supplied 
to the terminals 11 and 12, and decoded in the MPBG 
decoder 1 . The video image signal decoded the video 
stream which is supplied to the terminal 11 is supplied 
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through the terminal 13, and the write controller 135 
writes the memory in based on the synchronizing signal 
supplied through theterminal 29. The synchronizing sig- 
nal obtained the terminal 29 is one synchronizing to the 
video image signal of the video stream which is supplied s 
to the terminal 21 . The read controller 1 32 reads out the 
video image data from the memory 1 31 according to the 
synchronizing signal which is supplied through the ter- 
ming! 29. in this case, the data is possible to be enlarged 
or reduced by the control of the read-address. The com- 10 
bincr 1 33 combines the video image data read out from 
the memory 1 31 in the read controller 132 and the data 
suppicd ihrough the terminal 23, so as to output the 
combined video image signal to the terminal 1 34. This 
signal i£> disp:nyed by being supplied to the display de- *5 
vice not shown bui corresponding to the code 241 in 
FIGUHb H)i 

[0092] Here m the embodiments mentioned above, a 
decode or occssor comprised of the first and the second 
video decoders is explained, however, it is possible to 20 
be supphec lu n ducode processor comprised of n video 
image decoders (n 2 n is a positive number). 
[0093] That is in a decode processor provided with 
the n (n 2 n is u positive number) decoders for de- 
coding the n strenms of MPEG-encoded video image 25 
data transmitted in conjunction with the reference time 
information, at least one of the n decoders may be the 
basic processor (decode processor), as shown in FIG- 
URE 8 

[0094] Relating to FIGURE 14 and FIGURE 19, at 30 
least one video image signal of the n video image sig- 
nals supplied from the n decoders are stored in the 
memory based on the synchronizing signal of its video 
image signal..- and at least one video image signal of the 
n video image signals is read out based on the synchro- 35 
nizing signal of its video image signal, so that at least 
two video image signals of n video image signals are 
possible to be synchronized. 

[0095] Further, in reference to FIGURE 7, in a decode 
processor for decoding the n (n ^ 2, n is a positive 40 
number) streams of MPEG-encoded video image data 
transmitted in conjunction with the reference time infor- 
mation, it may be constructed by provided with the n ref- 
erence time information detectors for detecting the ref- 
erence time information contained in the n streams, at 45 
most n-1 clock generators for generating the clock of 
frequency which is not locked to the transmitter side 
clock of at least one stream of n streams, at most n-1 
counters for counting the clock from the clock generator, 
which count is corrected by the indication from the ref- $0 
erence time information detector, at least one counter 
for counting the clock from the clock generator, which is 
possible to correct the clock frequency of the clock gen- 
erator based on the comparison result of comparing its 
count and the at least one output value of the reference ss 
time information detector, the n synchronizing signal 
generators for generating the synchronizing signal 
based on the count of the n counters, and then decoders 
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for decoding the n streams according to the count of the 
n counters. 

[0096] Relating to the embodiment of FIGURE 12, in 
a decode processor for decoding the n (n ^ 2, n is a 
positive number) streams of MP EG -en coded video im- 
age data transmitted in conjunction with the reference 
time information, it may be constructed by provided with 
the n reference time information detectors for detecting 
the reference time information contained in the n 
streams, at most n-1 clock generators for generating the 
clock having the frequency which is not locked to the 
transmitter side clock of at least one stream of n 
streams, at least one counter for counting the clock from 
the clock generator, which is possible to correct the 
clock frequency of the clock generator based on the 
comparison result of comparing its count and at least 
one output value of the reference time information de- 
tector, at most n-1 reference time generators for gener- 
ating the reference time based on the output value from 
the reference lime information detector and the count of 
the counter, n synchronizing signal generators for gen- 
erating the synchronizing signal based on the count of 
at least one counter or the output value of at most n-1 
reference time generators, and the n decoders for de- 
coding the n streams according to the output value of 
the reference time generator and the count of the coun- 
ter. 

[0097] Relating to the embodiment of FIGURE 13, it 
is a decode processor for decoding the n (n £ 2, n is a 
positive number) streams of MPEG-encoded video im- 
age data transmitted in conjunction with the reference 
time information, it may be constructed by provided with 
the reference time information detector for detecting the 
reference time information contained in the n streams, 
the clock generator for generating the clock having the 
frequency which is not locked to the transmitter side 
clock of n-1 streams of n streams, the counter for count- 
ing the clock from the clock generator, the n reference 
time generators for generating the reference time based 
on the output value of n reference time information de- 
tectors and the count of the counter, n synchronizing sig- 
nal generators for generating the synchronizing signal 
based on the output value of the n reference time gen- 
erators, and the n decoders for decoding the n streams 
according to the output value of the n reference time 
generators. 

[0098] Further, referring to FIGURE 15, in a decode 
processor for decoding the n (n ^ 2, n is a positive 
number) streams of MPEG-encoded video image data 
transmitted in conjunction with the reference time infor- 
mation, it may be constructed by provided with the n ref- 
erence time information detectors for detecting the ref- 
erence time information contained in the n streams, at 
most n-1 clock generators for generating the clock hav- 
ing the frequency which is not locked to the transmitter 
side clock of at least one stream of n streams, at most 
n-1 counters for counting the clock from the clock gen- 
erator, which count is corrected by the indication from 
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the reference time information detector, at least one 
counter for counting the clock from the clock generator, 
which is able to correct the clock frequency of the clock 
generator based on the comparison result of comparing 
its count and at least one output value of the reference 
time information detector, at least one synchronizing 
signal generator for generating the synchronizing signal 
based on the count of at least one counter, n decoders 
for decoding n streams according to the count of n 
counters, which output the video image signals which 
are synchronized with the timing of the synchronizing 
signal by thinning out the video flame or outputting the 
same video image signal repeatedly for several times in 
the case that the timings of outputting from the counter 
and the synchronizing signal from the synchronizing sig- 
nal generator which gives the display timing are not 
matches. 

[0099] ' Referring to FIGURE 11 , a decode processor 
for decoding the n (n ^ 2, n is a positive number) 
streams of MPEG -encoded video image data transmit- 
ted in conjunction with the reference time information, it 
may be constructed by provided with n reference time 
information detectors for detecting the reference time in- 
formation contained in the n streams, at leas n-1 clock 
generators for generating the clock having the frequen- 
cy which is not locked to the transmitter side clock of at 
least one stream of n streams, at least one counter for 
counting the clock generated from the clock generator 
which is able to correct the clock frequency of the clock 
generator based on the comparison result of comparing 
its count and the at least output value of the reference 
time information detector, at most n-1 reference time 
generators for generating the reference time based on 
the output value of the reference time information de- 
tector and the count of the counter, at least one synchro- 
nizing signal generator for generating the synchronizing 
signal based on the count of at least one of the n 
counters, and at least one of n decoders outputs the vid- 
eo image signal synchronized with the timing of the syn- 
chronized signal by thinning out the video flame or out- 
putting the same video flame repeatedly for several 
times in the case that the timings of output from the ref- 
erence time generator and the synchronizing signal 
from the synchronizing signal generator which give the 
display timing are not matched. 

[0100] And at least one of n decoders outputs the vid- 
eo image signal synchronized with the timing of the syn- 
chronized signal by thinning out the video flame or out- 
putting the same video flame repeatedly for several 
times in the case that the timings of output from the ref- 
erence time generator and the synchronizing signal 
from the synchronizing signal generator which give the 
display timing are not matched. 

[0101] Referring to FIGURE 18, a decode processor 
for decoding the n (n i 2, n is a positive number) 
streams of MPEG -encoded video image data transmit- 
ted in conjunction with the reference time information, it 
may be constructed by provided with n reference time 



information detectors for detecting the reference infor- 
mation contained in n streams, the clock generator for 
generating the clock having the frequency which is not 
locked to the transmitter side clock of n-1 streams of the 
5 n streams., the counter for counting the clock from the 
clock generator, n reference time generators for gener- 
ating the reference time based on the output value from 
n reference time information detectors and the count of 
the counter, synchronizing signal generator for generat- 
10 ing the synchronizing signal based on one output value 
of one the n reference time generators, and the n de- 
coders for decoding the n streams according to the out- 
put value of the n reference time generators, and n-1 
decoders which output the video image signal synchro- 
's nized with the timing of the synchronizing signal by thin- 
ning out the video flame or outputting the same video 
flame repeatedly for several times in the case that the 
timings of the output from the reference time generator 
and the synchronizing signal from the synchronizing sig- 
20 nal generator which gives the display timing are not 
matched. 

[01 02] As described above, the present invention can 
provide an extremely preferable video image signal de- 
coding method and apparatus for decoding a plurality of 

25 decoded video image signals simultaneously. 

[0103] That is, according to the first aspect of the 
present invention, by generating the decode starting sig- 
nal which is common to each decoding video image sig- 
nal according to the system clock regenerated from the 

30 master stream the phase of the synchronizing signal is 
not disturbances even if the channel selected as the 
master stream is changed, when displaying a plurality 
of video images, which are decoded simultaneously, on 
the multi-windows, so that the displayed video image is 

35 not disturbed. 

[0104] Further, according to the first aspect of the 
present invention, since the output buffer memory for 
matching the time of the output video image signal, it is 
possible to eliminate the output buffer memories and 

40 thus possible to reduce the total capacity of the input 
and output buffer memories. So that, it is possible to re- 
duce the amount of hardware in the decoder and it is 
possible to be miniaturized, high reliance and a low pow- 
er consumption. 

45 [0105] Further, according to second aspect of the 
present invention, it is possible to performs a plurality of 
decode processors in one clock without the use of two 
or more clocks, and also possible to use only one syn- 
chronizing signal which is necessary for the decoding 

so output, so as to simplify the system design and improve 
the flexibility of the system. 

[0106] While there have been illustrated and de- 
scribed what are at present considered to be preferred 
embodiments of the present invention, it will be under- 
55 stood by those skilled in the art that various changes 
and modifications may be made, and equivalents may 
be substituted for elements thereof without departing 
from the true scope of the present invention. In addition, 
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many modifications may be made to adapt a particular 
situation or material to the teaching of the present in- 
vention without departing from the central scope there- 
of. Therefor, it is intended that the present invention not 
be limited to the particular embodiment disclosed as the s 
best mode contemplated for carrying out the present in- 2. 
vention, but that the present invention includes all em- 
bodiments falling within the scope of the appended 
claims. 

[0107] The foregoing description and the drawings 10 
are regarded by the applicant as including a variety of 
individually inventive concepts, some of which may lie 
partially or wholly outside the scope of some or all of the 3. 
following claims. The fact that the applicant has chosen 
at the time of filing of the present application to restrict is 
the claimed scope of protection in accordance with the 
following claims is not to be taken as a disclaimer or al- 
ternative inventive concepts that are included in the con- 
tents of the application and could be defined by claims 
differing in scope from the following claims, which differ- 20 
ent claims may be adopted subsequently during prose- 
cution, for example, for the purposes of a divisional ap- 4. 
plication. 



of the steps 2 through 5; and 
a seventh step for starting a decoding of the vid- 
eo image signal stored in the input buffer mem- 
ory by the decode starting signal. 

A video image signal decoding method as claimed 
in claim 1 , wherein the decode starting signal is a 
signal synchronizing a synchronizing signal of dis- 
playing which is not depend upon the decode start- 
ing time information contained in a video image sig- 
nal to be assigned to a master video image signal. 

A video image signal decoding method as claimed 
in claim 1 or 2, wherein the input buffer memory has 
a capacity larger than the data amount required for 
starting decoding based on the decode starting time 
information contained in the data by more than the 
maximum data amount supplied for one frame pe- 
riod of the video image signal assigned to a master 
video image signal. 

A decoder for decoding video image signal, com- 
prising: 



Claims 

1. A decoding method for decoding video image sig- 
nal, comprising the steps of: 

a first step for separating at least one of 
streams of video image signal to be decoded 
from a multiplexed stream received therein, 
which contains a plurality of video image sig- 
nals; 

a second step for selecting one stream includ- 
ing a video image signal to be assigned to a 
master video image signal, which will be as- 
signed to a master stream from the multiplexed 
stream; 

a third step for regenerating a reference time 
and a system clock which are used in decoding 
of the video image signal to assigned to the 
master video image signal, based on a refer- 
ence time information contained in the master 
stream; 

a fourth step for regenerating a reference time 
used for decoding the separated video image 
signal through the use of the reference time in- 
formation contained in the separated stream of 
the video image signal to be decoded and the 
regenerated system clock; 
a fifth step for generating a decode starting sig- 
nal through the use of the regenerated system 
clock; 

a sixth step for storing the video image signal 
contained in the separated stream in an input 
buffer memory, in parallel with the processing 
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25 a separator for separating at least one of 

streams of video image signal to be decoded 
from a multiplexed stream received therein, 
which contains a plurality of video image signal; 
a selector for selecting one stream including a 
video image signal to be assigned to a master 
video image signal, which will be assigned to a 
master stream from the multiplexed stream; 
at least one buffer memory for storing the video 
image signal contained in- each separated 
stream; 

a clock regenerator for regenerating a refer- 
ence time and a system clock which are used 
in decoding of the video image signal to as- 
signed to the master video image signal, based 
40 on a referencetime information contained in the 

master stream; 

a reference time regenerator for regenerating 
a reference time used for decoding the sepa- 
rated video image signal through the use of the 

45 reference time information contained in the 

stream of the video image signal to be decoded 
and the regenerated system clock; 
a decode starting signal generator for generat- 
ing a decode starting signal which is common 

50 - to each of the separated stream through the 

use of the regenerated system clock; and 
at least one decoder for starting a decoding of 
the video image signal stored in the input buffer 
memory by the decode starting signal. 

55 

5. A video image signal decoder as claimed in claim 
4, wherein the decode starting signal generated in 
the decode starting signal generator is synchro- 
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nized with the synchronizing signal in a display sys- 
tem which is independent to the decode starting 
time information contained in the video image signal 
to be assigned to a master video image signal. 

6. A video image signal decoder as claimed in claim 4 
or 5, wherein the input buffer memory has a capacity 
larger than the data amount required for starting de- 
coding based on the decode starting time informa- 
tion contained in the data by more than the maxi- 
mum ^data amount supplied for one frame period of 
the video image signal assigned to a master video 
image signal. 

7. A decode processor configured to decode a stream 
of MP EG -encoded video image data transmitted in 
conjunction with reference time information, com- 
prising: 

a reference time information detector for de- 
tecting the reference time information con- 
tained in the stream; 

a clock generator for generating a clock having 
a frequency which is not locked to a clock in a 
transmitter for transmitting the stream; 
a counter for counting the clock from the clock 
generator, which count is amended by the di- 
rection from the reference time information de- 
tector; 

a synchronizing signal generator for generating 
a synchronizing signal based on the count of 
the counter; and 

a decoder for decoding the stream according to 
the count of the counter. 

8. A decode processor as claimed in claim 7, wherein 
the timing that the count of the counter is amended 
by the direction from the reference time information 
detector will follow the synchronizing signal gener- 
ated in the synchronizing signal generator. 

9. A decode processor configured to receive n 
streams of MPEG-encoded video image data (n de- 
notes an integer of 2 or more; i.e., n ^ 2) transmitted 
in conjunction with the reference time information, 
wherein the decoder comprises at least one of de- 
coder as claimed in claim 7 or 8. 

10. A decode processor as claimed in claim 9, further 
comprising a synchronizer for synchronizing at 
least two video image signals in n video image sig- 
nals by memorizing at least one video image signal 
in the n video image signals supplied from the n de- 
coders based on the synchronizing signal of that 
one video image signal, and by reading the video 
image signal based on the synchronizing signal of 
at least one video image signal in the n video image 
signals. 



11. A decode processor configured to decode n (n de- 
notes an integer of 2 or more; i.e., n ^ 2) streams 
of MPEG-encoded video image data transmitted in 
conjunction with reference time information, com- 
prising: 

n reference time information detectors for de- 
tecting the reference time information con- 
tained in n streams; 

at most n-1 clock generators for generating a 
clock having a frequency which is not locked to 
a transmitter side clock of at least one stream 
in n streams; 

at most n-1 counters for counting the clock from 
the clock generator, which count is amended by 
the direction from the reference time informa- 
tion detector; 

at least one counter for counting the clocks from 
the clock generator which is correctable the 
clock frequency of the clock generator based 
on the comparison result of the count of the 
clock generator with the output value of at least 
one of the reference time information detectors; 
n synchronizing signal generators for generat- 
ing a synchronizing signal based on the count 
of n counters; and 

n decoders for decoding n streams according 
to the count of n counters. 

12. A decode processor configured to decode n (n de- 
notes an integer of 2 or more; i.e., n ^ 2) streams 
of MPEG-encoded video image data transmitted in 
conjunction with reference time information, com- 
prising: 

n reference time information detectors for de- 
tecting the reference time information con- 
tained in n streams; 

at most n-1 clock generators for generating a 
clock with a frequency which is not locked to a 
transmitter side clock of at least one stream in 
the n streams; 

at least one counter for counting the clock from 
the clock generator which is correctable the 
clock frequency of the clock generator based' 
on the comparison result of the count of the 
clock generator with at least one output value 
from the reference time information detector; 
at most n-1 reference time generators for gen- 
erating reference time based on the output val- 
ue of the reference time information detector 
and the count of the counter; 
n synchronizing signal generators for generat- 
ing the synchronizing signal based on the count 
of at least one counter or the output value of at 
most n-1 reference time generators; 
n decoders for decoding the n streams accord- 
ing to the output value of the reference time 
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generator or the count of the counter. 

1 3. A decode processor configured to decode n (n de- 
notes an integer of 2 or more; i.e., n ^ 2) streams 

of MPEG-encoded video image data transmitted in 5 
conjunction with reference time information, com- 
prising: 

n reference time information detectors for de- 
tecting the reference time information con- to 
tained in n streams; 

clock generator for generating the frequency 
which is not locked to the a transmitter side 
clock of at least one stream of n streams; 
counter for counting the clock from the clock * 5 
generator; 

n reference time generators for generating the 
reference time based on the output value of the 
n reference time information detectors and the 
count of the counter; 20 
n synchronizing signal generators for generat- 
ing the synchronizing signal based on the out- 
put value of the n reference time generators; 
and 

n decoders for decoding the n streams accord- 2s 
ing to the output value of the n reference time 
generators. 

14. A decode processor configured to decode n (n de- 
notes an integer of 2 or more; i.e., n > 2) streams 30 
of MPEG-encoded video image data transmitted in 
conjunction with reference time information, com- 
prising: 

n reference time information detectors for de- 35 
tecting the reference time information con- 
tained in n streams; 

at most n-1 clock generators for generating a 
clock having a frequency which is not locked to 
a transmitter side clock of at least one stream 40 
of n streams; 

at most n-1 counters for counting the clock from 
the clock generator, which count is amended by 
the direction from the reference time informa- 
tion detector; 45 
at least one counter for counting the clock from 
the clock generator, which is correctable the 
clock frequency of the clock generator based 
on the comparison result of the count of the 
clock generator with at least one output value so 
from the reference time information detector; 
at least one synchronizing signal generator for 
generating the synchronizing signal based on 
the count of at least one counter; 
n decoders, which decoding the n streams ac- 55 
cording to the n counters, for outputting the vid- 
eo image signal synchronized with the synchro- 
nizing signal by thinning out the video flame or 



outputting the same video flame repeatedly for 
several times, in the case that the timing of the 
output form the counter and the synchronizing 
signal from the synchronizing signal generator 
which makes the timing is not adjusted. 

15. A decode processor configured to decode n (n de- 
notes an integer of 2 or more; i.e., n ^ 2) streams 
of MPEG-encoded video image data transmitted in 
conjunction with reference time information, com- 
prising: 

n reference time information detectors for de- 
tecting the reference time information con- 
tained in n streams; 

at most n-1 clock generators for generating a 
clock having a frequency which is not locked to 
a transmitter side clock of at least one stream 
of n streams; 

at least one counter for counting the clock from 
the clock generator which is correctable the 
clock frequency of the clock generator based 
on the comparison result of the count of the 
clock generator with at least one output value 
from the reference time information detector; 
at most n-1 reference time generators for gen- 
erating the reference time based on the output 
value of the reference time information detector 
and the count of the counter; 
at least one synchronizer for generating the 
synchronizing signal based on the count of at 
least one in the n counters; and 
n decoders, which is decoding the n streams 
according to the output value of the reference 
time generator or the count of the counter, for 
thinning out the video image signal flame or out- 
putting the same video image signal flame re- 
peatedly for several times, in the case that the 
timing of the output from the reference time 
generator with the synchronizing signal from 
the synchronizing signal generator which 
makes the timing is not adjusted. 

16. A decode processor, which decodes n (n denotes 
an integer of 2 or more; i.e., n ^ 2) streams of 
MPEG-encoded video image data transmitted in 
conjunction with reference time information, com- 
prising: 

n reference time information detectors for de- 
tecting the reference time information con- 
tained in n streams; 

clock generator for generating the clock of the 
frequency which is not locked to the transmitter 
side clock of n-1 streams of n streams; 
counter foOr counting the clock from the clock 
generator; 

n reference time generators for generating ref- 
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erence time based on the output value from the 
n reference time information detectors and the 
count of the counter; 

synchronizing signal generator for generating 
the synchronizing signal based on one output 5 
value of n reference time generators; and 
n decoders, which decoding the n streams ac- 
cording to the output value of the n reference 
time generators, for outputting the video image 
signal synchronizing with the synchronizing io 
timing, by the n-1 decoders of n decoders thins 
out the video image signal flame or outputs the 
same video image signal flame repeatedly for 
several times in the case that the timing of the 
output from the reference time generator and *s 
the synchronizing signal from the synchroniz- 
ing signal generator which makes the timing is 
not adjusted. 

17. A decode processor as claimed in any one of claims 20 
10, 12, 13, 15 and 16, wherein the at least one of 
the n decoders performs the decoding processing 
through the use of the value obtained by adding the 
offset value to the count of the counter as the refer- 
ence time. 25 
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